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ABSTRACT 



A sound localization control apparatus is used to local- 
ize the sounds, which can be produced from a synthe- 
sizer and the like, at a target sound-image location. The 
target sound-image location is intentionally located in a 
three-dimensional space which is formed around a lis- 
tener who listens to the sounds. The sound localization 
control apparatus at least provides a controller, a plural- 
ity of sound-directing devices and an allocating unit. 
The controller produces a distance parameter and a 
direction parameter with respect to die target sound- 
image location. The allocating unit allocates acoustic 
data (e.g., two-channel binaural signals), representing 
the sounds to be localized, to the sound-directing de- 
vices in response to the distance parameter and the 
direction parameter. Each of the sound-directing de- 
vices is applied with each of predetermined sounding 
directions which are arranged in a horizontal plane with 
respect to the listener. Thus, each sound-directing de- 
vice performs a data processing on the acoustic data 
allocated thereto so as to eventually localize the sounds 
in each of the predetermined sounding direction. At 
least three sounding directions are required when local- 
izing the sounds. The sound-directing device can be 
configured by a finite-impulse response filter. 

22 Claims, 15 Drawing Sheets 
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ratio of reverberation sounds is controlled so as to sim- 

SOUND LOCALIZATION CONTROL APPARATUS ply control the sound-image localization. 

FIG. 2 is a block diagram showing a diagrammatical 

BACKGROUND OF THE INVENTION configuration of an example of the sound localization 

The present invention relates to a sound localization 5 contro1 a PP ai ? tus * £ 2 ' a nn ^ sl ^designates an 

control apparatus which controls a sound-image loca- mpUt ^fT* 1 * ^ . the aC0USt 1 1 ° * app 5?* ^ 

tion in a sound field in which several kinds of artificial numeraIs ^ and 2b designate multipliers to which the 

sounds are sounded acoustic data 15 supplied through the input-terminal 1. 

ii i 1 * j £• , i The multipliers 2a and 2£ function to divide the acoustic 

Conventionally, several kinds of sound localization « rt j * ^ *■ i^i-** x*- * * -i i j , u 

^ - , . , . . , , 10 data by use of multiplication coefficients 2ak and 2bk 

metnods are proposed in order to obtain a desired i_- i_ , c r . . , . , N 

a c u cc . i. - , , <- , , " which are supplied from a control portion (not shown), 

sound-field effect which simulates a sound-field effect ^ ^p^^ coefficients zJjtand 2bk are deter- 

of a theater or an auditorium. FIG. 1 shows one of such ^ a sum of them becomes equal to "1". 

measuring methods by which the sound-field effect of a part of ^ acoustic ^ ^ out p Utte d f rom the 

the theater to be simulated is experimentally measured 15 multiplier 2a and is supplied to multipliers Ml to M12, 

by use of a dummy head DH. On the basis of results of whi i e part 0 f the acoustic data is outputted 

the measurements, sounding data are processed so as to f rom the multiplier 2b and is supplied to a reverberation . 

obtain a sound localization effect which is similar to that circuit RV. 

of the real theater. The dummy head DH shown in FIG. Incidentally, a mixing ratio by which the acoustic 
1 has a predetermined shape which is similar to the 20 data is mixed with reverberation data is set small when 
shape of a human head. At positions where right and the target sound-image location is relatively close to the 
left ears are located in the human head, microphones listener, while it is set large when the target sound- 
MR and ML are respectively attached to the dummy image location is relatively far from the listener, 
head DH. The reverberation circuit RV forms the reverbera- 
In FIG. 1, a location of a sound source can be defined 25 tion data on the basis of the acoustic data which is sup- 
by a horizontal angle <f>, a vertical angle 6 and a distance plied thereto through the multiplier 2b. The reverbera- 
D (which is fixed at 1 m, for example). The dummy tion data is divided into two components, Le., a right- 
head DH detects the sounds produced from the above channel component and a left-channel component. The 
sound source in form of the waveforms which are trans- right-channel component of the reverberation data is 
mitted to the left and right ears, thus measuring a differ- 30 supplied to an adder 3R, while the left-channel compo- 
ence between the waveform detected and an original nent °f tne reverberation data is supplied to an adder 
waveform representing the sound produced from the 3L. On thebasisofmultiphcationcoerricientsCltoC12 
sound source. Such measurement is carried out with given from the aforementioned control portion, the 
respect to the sounds to be respectively produced from multipliers Ml to M12 respectively carry out multipli- 
the sound sources which are respectively arranged in a 35 cations , on ^ e acoustic data which is outputted from the 
virtual space as shown in FIG. 1. On the basis of data multiplier 2a. 

representing the results of the measurements, a so-called Symbols "dirl" to *'dirl2" designate sound-directing 

head-related transfer function is computed with respect devices, which respectively perform convolution oper- 

to each of the locations of the sound sources. Herein, ations based on ^ hea d-related transfer function on the 

the head-related transfer function is used to convert the 40 out P ut ^ of multi P uers M1 tc > M12. Thus, each of 

waveform of the sound produced from the sound source the sound-directing devices eventually produces a 

into another waveform corresponding to the sound nght-channel component and a left-channel component 

which is transmitted to the right ear or left ear of the m * respect t0 f oustlc data - Then ' nght-chan- 

dummy head DH component of the acoustic data is supplied to the 

Next, an electronic configuration of a finite-impulse 45 ^A^. ^ri^^l 00 ^^ 0 ^ 6 
response filter (Le., FIR filter) is determined responsive ZCOV ?° 15 * up ? hed . t0 add « 3L : ^ 
to £e head-related transfer function computed Then, ^d-dir^tag devices » configured as shown m FIG. 

acoustic data corresponding to the sound produced ^™f!trS m parallel 

„ . . j-rrn ° « . j ■ j Herein, the FIR filter can be embodied by a LSI circuit 

applied to the FIR filter corresponding to a desired <n ^w:' i„ „ m j r- r. , ^ 

-~ i v *• ru - c, e , 50 exclusively used for performing the convolution opera- 

* l^^f 01 *^^^- « « tion or a digital signal processor G-e., DSP), while a 

uu-ge. .so.ma-.mage location^, in tne_MK Jitter, the coefficient ROM storing coefficients which are used for 
acoustic data is processed and is subjected to digital ^e myMism operation is externally provided. 
^^^^^^'^^^^^^ In order to simplify the description, each of the 
the output of the FIR filter, a person (i.e., hstener) who 55 sound^ectmg devices dirl to dirl2 is configured with 
listens to the sound produced may feelasif thesoundis respect t0 ^ horizontal direction only. For example, 
actually produced from the target sound-image loca- the sound-directing device dirl corresponds to a front 
t10 "' direction of the listener, in other words, the horizontal 

When configuring the FIR filter corresponding to the angle 0 f the sound-directing device dirl is set at 0% 
head-related transfer function, it is possible to compute 60 while the sound-directing device dir2 corresponds to a 
the head-related transfer function as described above. certain right-side direction which deviates from the 
Or, an impulse (or tone burst) is produced from the front direction of the listener by 30°, in other words, the 
sound source, and then, an amplitude of its impulse- horizontal angle of the sound-directing device dir2 is set 
response waveform is used as a coefficient, by which at 30°. Similarly, the horizontal angles of the adjacent 
the FIR filter is configured. 65 sound-directing devices are deviated from each other 

According to an example of the sound localization by 30*; therefore, the last sound-directing device dirl2 
control apparatus which employs the aforementioned corresponds to a certain left-side direction which devi- 
method of measuring the sounding effects, a mixing ates from the front direction of the listener by 30°, in 
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other words, the horizontal angle of the sound-directing corresponding to the sound source which is located in a 
device dirl2 is set at 330°. Each of the sound-directing direction of horizontal angle 30*. In another sound- 
devices performs the convolution operation based on directing device dir3, another convolution operation is 
the head-related transfer function corresponding to the performed on the acoustic data on the basis of another 
sound source whose sound-image location corresponds 5 head-related transfer function corresponding to another 
to the horizontal angle thereof. sound source which is located in a direction of horizon- 
Now, the acoustic data whose sound-image location tal angle 60°. Then, the right-channel components for 
must be fixed at the location defined by the horizontal the acoustic data respectively outputted from the 
angle 30° is applied to the input terminal 1, through sound-directing devices dir2 and dir3 are supplied to the 
which the acoustic data is supplied to the multipliers 2a 10 adder 3R, while the left-channel components for the 
and 2b. The : multipliers 2a and 2b receive the multiplica- acoustic data respectively outputted from the sound- 
tion coefficients 2ak and 2bk respectively, which corre- directing devices dir2 and dir3 are supplied to the adder 
spond to the distance between the listener and the target 3L. 

sound-image location. By use of the multiplication coef- On the other hand, the multiplier 2b performs the 
ficients 2ak and 2bk, the multipliers 2a and 2b respec- 15 multiplication using the multiplication coefficient 2bk 
tively perform the multiplications on the acoustic data. on the acoustic data, so that the output data of the multi- 
The results of the multiplications are delivered to the plier 2b is supplied to the reverberation circuit RV. In 
multipliers Ml to M12 and the reverberation circuits the reverberation circuit RV, the right-channel compo- 
RV as described before. In this case, a direction in nent and left-channel component for the reverberation 
which the sound corresponding to the acoustic data is 20 data are computed, and then, they are respectively sup- 
to be localized (hereinafter, simply referred to as a tar- plied to the adders 3R and 3L. 

get sound-image direction) corresponds to the horizon- In the adders 3R and 3L, the acoustic data outputted 

tal angle 30*. Thus, the aforementioned control portion from the sound-directing devices dir2 and dir3 are 

automatically selects the sound-directing device dir2 added with the reverberation data outputted from the 

performing the convolution operation based on the 25 reverberation circuit RV; and finally, two-channel data 

head-related transfer function corresponding to the corresponding to the original acoustic data are ob- 

sound source which is located in a direction of horizon- tained. 

tal angle 30*. In other words, only the multiplication In the sound localization control apparatus described 
coefficient C2 which is supplied to the multiplier M2 is above, a distance between the listener and the sounding 
set at "1", while the other multiplication coefficients for 30 point (i.e., sound source) is controlled by the mixing 
the multipliers Ml and M3 to M12 are all set at "0". ratio with respect to the reverberation sounds. There- 
in the sound-directing device dir2 to which the fore, it may be possible to obtain a weak impression by 
acoustic data outputted from the multiplier M2 is only which the listener may feel as if the size of the room is 
supplied, the convolution operation is performed on the changed in response to the above mixing ratio. How- 
acoustic data so as to produce the right-channel compo- 35 ever, the distance between the listener and the sound 
nent and left-channel component for the acoustic data, source cannot be controlled well so that the sound- 
which are respectively supplied to the adders 3R and image location cannot be fixed well. 

The above-mentioned drawback may be eliminated 
Meanwhile, the output data of the multiplier 2b is by changing the aforementioned distance D (which has 
converted into the reverberation data by the reverbera- 40 been previously fixed at 1 m) and re-designing the elec- 
tion circuit RV, so that the right-channel component tronic configuration of the apparatus such that the 
and left-channel component for the reverberation data sound-directing devices are further provided with re- 
are respectively supplied to the adders 3R and 3L. spect to the predetermined distances as well as the pre- 
Thereafter, a sum of the acoustic data outputted from determined directions. In such case, however, a large 
the sound-directing device dir2 and the reverberation 45 number of the sound-directing devices should be re- 
data outputted from the reverberation circuit RV is quired, resulting that a system size of the apparatus must 
outputted from the sound localization control apparatus become extremely large. 

shown in FIG. 8. According to the results of the experiments which are 
In the meantime, when locating the sound image in a carried out with respect to sampling frequencies rang- 
direction of horizontal angle 45*, the multiplication 50 ingfrom40 kHz to 50 kHz, when embodying the head- 
coefficients C2 and C3 for the multipliers M2 and M3 related transfer function with respect to each of the 
are set at the same value, while the other multiplication distances as well as each of the directions, the FIR filter 
coefficients for the multipliers Ml and M4 to M12 are must be configured by hundreds of operational circuits 
all set at "0". Since the multipliers M2 and M3 are only (more specifically, thousands of operational circuits), 
activated, the sound-directing devices dir2 and dir3 55 and such large-scale FIR filter should be provided for 
which correspond to the horizontal angles 30' and 60* each of the right channel and left channel, 
respectively are only activated. And, it is also required that the sound localization 
More specifically, the acoustic data is supplied to the control apparatus utilizing the above-mentioned large- 
multiplier 2a in which the multiplication using the mul- scale FIR filter should cover the space having a semi- 
tiplication coefficient 2ak is performed, and then, the 60 spherical shape as shown in FIG. 1, the radius of which 
output data of the multiplier 2a is delivered to the multi- is set at 10 m, for example. In this case, the apparatus 
pliers Ml to M12. In this case, however, only the sound- should control the sound-image localization with re- 
directing devices dir2 and dir3 receive the acoustic data spect to twelve directions (i.e., every 30-degree direc- 
through the multipliers M2 and M3 which are activated, tion in 360*) as well as one-hundred distance stages (i.e., 
while the other sound-directing devices do not receive 65 every 100 mm distance in 10 m). In order to do so, the 
the acoustic data. In the sound-directing device dir2, apparatus should have an operating capacity by which 
the convolution operation is performed on the acoustic the multiplications and additions can be performed by 
data on the basis of the head-related transfer function one-hundred and twenty million times per one second, 
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wherein such number of "one-hundred and twenty mil- perform an interpolation operation on plural pairs of the 
lion" is calculated as follows: 2 (representing a number coefficients when computing a pair of coefficients cor- 
of the FIR filters to be required) X 12 (representing a responding to the sound-image location which is not 
number of the directions)X 100 (representing a number actually measured. Incidentally, the control portion 3 is 

of the distance stages) X 50000 (Hz). 5 designed to change a pair of coefficients at each sam- 

As the method which controls the sound-image loca- pling period, 
tion to be moved arbitrarily by use of the sound-direct- The above-mentioned coefficient time- varying 
mg devices, there are provided two methods, i.e., a method accurately works in accordance with a princi- 
coefficient time-varying method and a virtual speaker ple of the S0U nd localization. Thus, it is expected that 
method, for example. FIG. 4 is a block diagram show- 10 the sound image obtained is accurately and clearly Ic- 
ing an example of the sound localization control appara- at ^ S0U nd-image location. However, in 
to employing the coefficient time-varying method. In order to obtain ^ ability t0 sufflcien tiy control the 
FIG. 4, acoustic data SI (e.g., digital data representing sound localization, hundredsof or thousands of coeffici- 
tiesoundsofthe^runnm^ ents must be ^ for the Meeting devices 
mg sound-directmg portion IS, and is divided into the 15 ^ ^ 2R reS pectively. In other words, it is necessary 
^^J^TT ^^"f^^f^^ponent, t0 ^ a s^Mgh-speed processor which can 
vl^ranT^ SUPP ^A^bnamg de- cha £ ge over a^drel of or ^ ousands of coeffici . 

A control portion 3 outputs a pair of the coefficients, w ^^rrr^g ihe interpolation operations at 
corresponding to the target Lund-image location 20 ^ ^ P ^f P f *£* the fre ; 
wmchare respectively supplied to the souL-directing quenCy 15 50 ^^er, the above super-high-speed 
devices 2L and 2R. Thus^e acoustic data SI is sub? ^ sam ^ * prOV,ded f *^ dS 
jected to signal processing corresponding to the convo- w *f* S °™ d ™ ageS ^jesr^Uyely locabzed at differ- 
lution operation using a pair of coefficients. Then, the °^ tl0ns * Slnce «* super-high-speed processor is 
right^hannel component and left-channel component 25 relativel y expensive, the system cost required for the 
for the acoustic data SI are respectively produced. apparatus becomes extremely high. For this reason, the 
Incidentally, a pair of the coefficients to be respectively a PPf a ** employing the coefficient time-varying 
supplied to the sound-directing devices 2L and 2R is m t?° d has ? ot been manufactured ' 
read from a coefficient memory 4 in response to the Different from the above-mentioned coefficient time- 
target sound-image location by the control portion 3. 30 var y™g method, the virtual speaker method does not 

If there exists any other acoustic data (e.g., digital vary me coefficients in real time so that the virtual 
data representing the musical sounds produced from the speaker method uses the fixed coefficients, whereas this 
musical instrument such as the trumpet) the sound method requires a plenty of sound-directing devices, 
image of which is to be localized, another time-varying Each of tne sound-directing devices corresponds to 
sound-directing portion can be provided, in other 35 63011 of locations which are tightly arranged in the 
words, a plurality of time-varying sound-directing por- predetermined space. Thus, instead of varying a plenty 
tions can be provided in the apparatus. If another acous- °^ coefficients in each sampling period, the virtual 
tic data S2 is supplied to another time-varying sound- speaker method switches over the sound-directing de- 
directing portion IS2, it is subjected to the signal pro- vice to whicn the acoustic data is supplied, 
cessing as described above. Thereafter, the left-channel 40 5 is a block diagram showing an example of the 
component of the acoustic data SI and the left-channel sound localization control apparatus employing the 
component of the acoustic data S2 are added together virtual speaker method. Herein, twelve locations are 
by an adder 5L, while the right-channel component of determined in advance so that twelve pairs of the 
the acoustic data SI and the right-channel component sound-directing devices (i.e., 9Li, 9Ri, . . . , SML12, 9R !2 ). 
of the acoustic data S2 are added together by an adder 45 The acoustic data (SI, S2, . . . ) are supplied to the 
SR. Thus, added data for the left channel is obtained sound-directing devices in which they are subjected to 
from a terminal U L M , while another added data for the signal processing corresponding to the convolution 
right channel is obtained from a ter minal "R". operation using a selected pair of the coefficients, so 

Under the operation of the above-mentioned appara- tbat two-channel data are eventually produced. When 

tus, it may be possible to smoothly move the target 50 hearing the sounds corresponding to the two-channel 

sound-image location with respect to the acoustic data data, the listener may feel as if the sounds are actually 

SI so that the listener may feel as if the car is running produced from a speaker which is located at a desired 

away. In this case, however, every time the target location corresponding to the selected pair of the coeffi- 

sound-image location is changed, the control portion 3 cients. This speaker is called a virtual speaker which is 

should read out a pair of coefficients, corresponding to 55 not actually existed but from which the sounds are 

the target sound-image location changed, from the coef- virtually produced. 

ficient memory 4 so as to supply the coefficients to the When using two virtual speakers, the acoustic data 
sound-directing devices 2L and 2R respectively. In can be allocated to the virtual speakers respectively by 
such case, there is a possibility in that noises may be a predetermined ratio so that the sound-image location 
occurred at each time when the coefficients to be read 60 can be fixed at a desired point which exists between two 
from the coefficient memory 4 are changed. In order to virtual speakers. If the same amount of the acoustic data 
avoid an occurrence of noises, the coefficient memory 4 is allocated to each of the virtual speakers, the sound* 
should store plenty of coefficients, each pair of which image location can be fixed at a mid-point between two 
corresponds to each of the locations which are arranged virtual speakers. Under the consideration of the above 
to cover the predetermined space as a whole. If a num- 65 operating principle, by changing an allocation ratio by 
ber of the coefficients, each pair of which corresponds which the acoustic data is allocated to the virtual speak- 
to each of the sound-image locations actually measured ers respectively, it is possible to smoothly move the 
in the predetermined space, is limited, it is necessary to sound-image location between the virtual speakers. 
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FIG. 5 is a block diagram showing an example of the 
sound localization control apparatus employing the 
virtual speaker method. In FIG. 5, an allocating unit 
6S1 contains multipliers 7L1 to 7L12 and 7R1 to 7R12, 
each of which performs a weighed multiplication when 5 
allocating a series of acoustic data represented as acous- 
tic data SI. Another allocating unit 6S2 has a similar 
configuration of the allocating unit 6S1, so that each 
multiplier performs a weighted multiplication when 
allocating another series of acoustic data represented as 10 
acoustic data S2. Then, each of the pieces of the acous- 
tic data SI outputted from the allocating unit 6S1 is 
added with the corresponding one of the pieces of the 
acoustic data S2 outputted from the allocating unit 6S2 
by each of adders 8L1 to 8L12 and 8R1 to 8R12 which 15 
are respectively coupled with sound-directing devices 
9L1 to 9L12 and 9R1 to 9R12. Each of the sound-direct- 
ing devices 9L1 to 9L12 and 9R1 to 9R12 performs a 
convolution operation corresponding to a location of its 
virtual speaker. Thus, the sound-directing devices 9L1 20 
to 9L12 eventually output left-channel components for 
the acoustic data SI and S2 mixed together, while the 
sound-directing devices 9R1 to 9R12 eventually output 
right-channel components for the acoustic data SI and 
SI mixed together. Finally, those left-channel compo- 25 
nents are added together by an adder 10L, while the 
right-channel components are added together by an 
adder 10R. As a result, two-channel data are eventually 
outputted from the adders 10L and 10R. 

However, even when performing the virtual speaker 30 
method, it is not possible to clearly fix the sound-image 
location at the desired location. Because, the virtual 
speaker method basically functions to merely adjust an 
tone- volume balance between the virtual speakers when 
detennining the sound-image location. Although a 35 
delay-time difference between the right-channel sound 
and left-channel sound should be adjusted in connection 
with the target sound-image location, the virtual 
speaker method merely adjusts such delay-time differ- 
ence between the adjacent virtual speakers. Therefore, 40 
in order to obtain a clear sound-image localization fixed 
between the virtual speakers, it is necessary to reduce 
the delay-time difference between two virtual speakers 
which are arranged closely adjacent to each other such 
that the delay-time difference may be negligible. 45 

In order to do so, however, it is necessary to provide 
an extremely large number of sound-directing devices, 
which eventually raise up the system cost for the appa- 
ratus. In the virtual speaker method, even if the number 
of the sounds to be localized (i.e., the number of the 50 
acoustic data applied) is increased, the sound localiza- 
tion control can be simply performed by merely increas- 
ing the number of the allocating units without increas- 
ing the number of the sound-directing devices. Thus, 
the virtual speaker method is advantageous in that the 55 
system cost may not be increased so much when in- 
creasing the number of the sounds to be localized. 

As described before, the coefficient time-varying 
method is not realistic because the super-high-speed 
processors are required so that the system cost must be 60 
extremely increased. 

Moreover, the virtual speaker method is not realistic 
because so many number of the sound-directing devices 
(e.g., hundreds of or thousands of sound-directing de- 
vices) are required in order to obtain a clear sound 65 
localization. If the number of the virtual speakers are 
reduced so that the density of the virtual speakers pro- 
vided in the predetermined space is reduced, it is not 
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possible to clearly put the sound-image location at a 
desired location between the virtual speakers. 

SUMMARY OF THE INVENTION 

Accordingly, it is an object of the present invention 
to provide a sound localization control apparatus which 
can clearly control the sound localization effect with a 
relatively small system configuration and without rais- 
ing the system cost. 

A sound localization control apparatus as defined by 
the present invention at least comprises a plurality of 
sound-directing devices, a controller and an allocating 
unit- 
Each of the sound-directing devices has a function to 
localize the sounds corresponding to acoustic data ap- 
plied thereto in each of predetermined sounding direc- 
tions. The controller produces a direction parameter 
and a distance parameter in connection with a target 
sound-image location at which the sounds are localized. 
Herein, the direction parameter designates a direction 
from a listener who listens to the sounds to the target 
sound-image location, while the distance parameter 
designates a distance between the listener and the target 
sound-image location. The allocating unit selects at 
least one of sound-directing devices in response to the 
direction designated by the controller, so that the allo- 
cating unit allocates the acoustic data to the sound- 
directing device selected, while the allocating unit also 
allocates the acoustic data to one or some of the sound- 
directing devices, other than the sound-directing device 
selected, in response to the distance designated by the 
controller. 

Thus, outputs of the sound-directing means are mixed 
together so as to reproduce the sounds corresponding to 
the acoustic data which are localized in accordance 
with the target sound-image location. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Further objects and advantages of the present inven- 
tion will be apparent from the following description, 
reference being had to the accompanying drawings 
wherein the preferred embodiments of the present in- 
vention are clearly shown. 

In the drawings: 

FIG. 1 is a drawing showing a virtual space in which 
a dummy head is provided so that the sounding effects 
are experimentally measured so as to obtain a head- 
related transfer function; 

FIG. 2 is a block diagram showing an example of the 
sound localization control apparatus; 

FIG. 3 is a block diagram showing a detailed configu- 
ration for each of sound-directing devices shown in 
FIG. 2; 

FIG. 4 is a block diagram showing another example 
of the sound localization control apparatus employing 
the coefficient time-varying method; 

FIG. 5 is a block diagram showing a still another 
example of the sound localization control apparatus 
employing the virtual speaker method; 

FIG. 6 is a block diagram showing an electronic 
configuration of the sound localization control appara- 
tus according to a first embodiment of the present in- 
vention; 

FIG. 7 is a graph showing a relationship between a 
distance and each of multiplication coefficients used for 
multipliers shown in FIG. 6; 
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FIG. 8 is a block diagram showing a detailed configu- ents "a" and **b". Those multiplication coefficients "a" 

ration of an allocating unit for short distance shown in and "b" are given from a control portion 17. 

FIG. 6; The control portion 17 determines the multiplication 

FIG. 9 is a graph showing a relationship between a coefficients "a" and "b" so as to supply them to the 

horizontal angle and each of multiplication coefficients 5 multipliers 16a and 16b respectively. Those multiplica- 

used for multipliers shown in FIG. 8; tion coefficients "a" and "b" are controlled in response 

FIG. 10 is a block diagram showing a detailed config- to the distance data D given from the sound localization 

uration of an allocating unit for long distance shown in controller 14 as shown in FIG. 7. More specifically, the 

FIG. 6; multiplication coefficient 4 V* supplied to the multiplier 

FIG. 11 is a graph showing a relationship between a 10 \fa j s increased larger as the distance D becomes larger, 

horizontal angle and each of multiplication coefficients while the multiplication coefficient 4 V is decreased 

used for multipliers shown in FIG. 10; smaller as the distance D becomes larger. 

FIG. 12 is a graph showing an example of the impulse a numeral 18/? designates an allocating unit for short 

response characteristic; distance. This allocating unit 18/2 provides one input 

FIG. 13 is a block diagram showing an electronic I 5 and twelve outputs. When receiving the output data of 
configuration of a sound localization control apparatus the multiplier 16b (representing the acoustic data pro- 
according to a second embodiment of the present inven- cessed), the allocating unit I8/1 allocates the data to one 
tion; of or some of twelve destinations. FIG. 8 shows a de- 

FIG. 14 is a graph showing a relationship between tailed configuration of the allocating unit 18jl In re- 
each allocating coefficient and the horizontal angle <f>; 20 S ponse to the horizontal angle <J>, a coefficient generator 

18/ic generates multiplication coefficients ki to kn so as 

FIG. 15 is a perspective-side view illustrating an t0 supply them to multipliers I8/1I to 18/il2 respec- 

appearance and a partial configuration of a controller tively. A relationship between the horizontal angle <f> 

which is used to designate a sound-image location. ^ of the multiplication coefficients ki to ki 2 is 

DESCRIPTION OF THE PREFERRED shown in FIG. 9. FIG. 9 shows a variation for each of 

EMBODIMENTS me multiplication coefficients ki, k 2 , k3, k4 and ki2 in 

connection with the horizontal angle cf>. When compar- 

[A] First Embodiment i ng two coefficients ky and k/_i (where 2^j^l2), a 

FIG. 6 is a block diagram showing an electronic 30 waveshape of the coefficient k/ is moved rightward by 

configuration of a sound localization control apparatus 30* from a waveshape of the coefficient k/_i. The same 

according to a first embodiment of the present inven- thing can be said with respect to the other coefficients 

tion. In FIG. 6, a numeral 14 designates a sound local- ks to kn. Among the multiplication coefficients ki to 

ization controller which determines the target sound- kn respectively supplied to the multipliers I8/1I to 

image locations for the sounds. This sound localization 35 18wl2, two or less of them are set at "0" simultaneously, 

controller 14 provides two slide switches 14a, 146 and In FIG. 6, a numeral 18/ designates an allocating unit 

one dial control 14c Herein, an actuator (i.e., knob) of for long distance. This allocating unit 18/has one input 

the slide switch 14a is slid to set the vertical angle 6 for and twelve outputs and is designed to allocate the out- 

the target sound-image location; an actuator of the slide put data of the multiplier 16a to the sound-directing 

switch 146 is slid to set the distance D for the target 40 devices. FIG. 10 shows a detailed configuration of the 

sound-image location; and a rotary portion of the dial allocating unit 18/ In FIG. 10, a numeral l$fc desig- 

control 14c is rotated to set the horizontal angle <J> nates a coefficient generator which determines multipli- 

(ranging from 0* to 360*) for the target sound-image cation coefficients mi to mn respectively supplied to 

location. multipliers 18/1 to 19fl2 in response to the horizontal 

In the sound localization controller 14, the vertical 45 angle 4>. A relationship between the horizontal angle <f> 

angle 0, distance D and horizontal angle <f> are respec- and each of the multiplication coefficients mi to nu and 

tively translated into vertical angle data S0, distance mi2 is shown in FIG. 11. When comparing the multipli- 

data SD and horizontal angle data S<#>. cation coefficients mj and ny_ 1, a waveshape of the 

A numeral 15 designates a notch filter which receives multiplication coefficient m/is moved rightward by 30° 

acoustic data through an input terminal 11 from an 50 from a waveshape of the multiplication coefficient 

electronic device or a sound source of a video game m/_i. The same thing can be said with respect to the 

device, for example. In response to the vertical angle other multiplication coefficients mstomu. 

data SB given from the sound localization controller 14, Among the multiplication coefficients supplied to the 

the notch filter 15 performs a frequency-band-eliminat- multipliers 18/1 to 18/L2 provided in the allocating unit 

ing process on the acoustic data so as to output pro- 55 18/ three or more of them are simultaneously set in a 

cessed acoustic data, the sound image of which is local- positive state. 

ized in a direction of the vertical angle 0. In FIG. 6, symbols FIR1 to FIR12 designate sound- 
By use of the notch filter, it is possible to control the directing devices which are similar to the aforemen- 
sound localization in a vertical-angle direction. The tioned sound-directing devices dirl to dirl2 shown in 
details are described in some articles such as an article 60 FIG. 2. Each of the sound-directing devices FTR1 to 
entitled "Psychoacoustical aspects of synthesized ver- FIR12 performs a data processing responsive to the 
tial locale cues" written by Anthony J. Watkins in J. horizontal angle <$> and the distance D in connection 
A co ust. Soc. Am. 63(4), Apr. 1978. Therefore, the de- with the target sound-image location, 
tailed explanation for the operations of the notch filter is Further, a numeral 19R designates an adder which 
omitted. 65 adds right-channel components of the output data of the 
Numerals 16a and 166 designate multipliers which sound-directing devices FIR1 to FIR12 so as to form 
respectively perform multiplications on the output data right-channel acoustic data. On the other hand, an 
of the notch filter .15 by use of multiplication coeffici- adder 19L adds left-channel components of the output 
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data of the sound-directing devices FIR1 to FIR12 so as an allocating rate for the sound-directing device FIR4 is 

to form left-channel acoustic data. set at 0.1, for example. As described above, when the 

Moreover, a cross-talk canceller 20 performs a prede- target sound-image location is relatively far from the 

termined anti-cross-talk processing on the right-channel location of the listener, a directional component for the 

acoustic data and the left-channel acoustic data respec- 5 target sound-image location is somewhat diffused so as 

tively outputted from the adders 19R and 19L, thus to eventually apply a long-range distance effect to the 

eliminating a cross-talk component which is occurred sound image to be localized. 

between the right-channel and left-channel sounds The output data of the allocating unit 18/z for short 
when actually reproducing the sounds in the predeter- distance (i.e., short-distance data) are adequately added 
mined space. Then, the right-channel acoustic data and 10 with the output data of the allocating unit 18/ for long 
the left-channel acoustic data respectively processed by distance (i.e., long-distance data), resulting that interpo- 
the cross-talk canceller 20 are supplied to speakers (not lation operations are carried out on the above long-dis- 
shown) through an amplifier 21. tance data and short-distance data; in other words, the 
When activating the apparatus shown in FIG. 6, a long-distance data and the short-distance data are ade- 
person operates the slide switches 14a, 14b and the dial 15 quately mixed together. Then, mixed data is supplied to 
control 14c provided in the sound localization control- each of the sound-directing devices FIR1 to FIR12, 
ler 14 so as to set the vertical angle 0, the distance D and Each of the data supplied to the sound-directing devices 
the horizontal angle <f> respectively in connection with FIR1 to FIR12 is divided into the right-channel compo- 
the target sound-image location. Next, a sound produc- nent and left-channel component on which the prede- 
ing unit (not shown) supplies the acoustic data to the 20 termined convolution operation is carried out Thereaf- 
notch filter 15 through the input terminal 11. Since the ter, the left-channel components outputted from the 
vertical angle data SO corresponding to the vertical sound-directing devices FIR1 to FIR12 are added to- 
angle $ has been already applied to the notch filter 15, gether by the adder 19L, while the right-channel com- 
the notch filter 15 performs a data processing on the ponents are added together by the adder 19R. The 
acoustic data in response to the vertical angle 0. Thus, 25 right-channel acoustic data and the left-channel acous- 
the output data of the notch filter 15 represents the tic data (i.e., two-channel binaural-signal data) respec- 
acoustic data to which a sound localization process has tively outputted from the adders 19L and 19R are sup- 
been carried out with respect to the vertical angle. The plied to the cross-talk canceller 20. 
output data of the notch filter 15 is delivered to both of The cross-talk canceller 20 performs the anti-cross- 
the multipliers 16a and 16b, 30 talk processing on the right-channel acoustic data and 
Meanwhile, the control portion 17 receives the dis- the left-channel acoustic data so as to eventually elimi- 
tance data SD corresponding to the distance D from the nate the cross-talk components. The cross-talk compo- 
sound localization controller 14. On the basis of the nents are occurred in response to a position relationship 
distance data SD, the control portion 17 determines a among the listener and two speakers. More specifically, 
dividing rate for the acoustic data so as to set an amount 35 a part of the right-channel sound is transmitted to the 
of the acoustic data on which a data processing for long left "ear of the listener, while a part of the left-channel 
distance is carried out. Based on the dividing rate deter- sound is transmitted to the right ear of the listener, 
mined, the control portion 17 computes the multiplica- Those parts of the sounds will form the cross-talk com- 
tion coefficients "a" and "b" to be supplied to the multi- ponents. After being processed by the cross-talk cancel- 
pliers 16er and 166 respectively. 40 ler 20, the right-channel acoustic data and the left-chan- 
The output data of the notch filter 15 is multiplied by nel acoustic data are amplified by the amplifier 21; and 
the multiplication coefficient "a" by the multiplier 16a, then, they are supplied to left and right speakers (not 
so that a result of the multiplication is supplied to the shown), from which stereophonic sounds are produced, 
allocating unit 18/for long distance. On the other hand, According to the aforementioned configuration of 
the output data of the notch filter 15 is multiplied by the 45 the sound localization control apparatus according to 
multiplication coefficient "b" by the multiplier 166, so the first embodiment of the present invention, as a dis- 
that a result of the multiplication is supplied to the alio- tance between the listener and the target sound-image 
eating unit 18/7 for short distance. location becomes larger, a sound localization to be con- 
As described before, the allocating unit 18/i performs trolled becomes unclear. Thus, even if a long distance is 
a data processing in response to the horizontal angle <f> 50 existed between the listener and the target sound-image 
(e.g., 45°) with respect to the target sound-image loca- location, it is possible to impart a natural sound localiza- 
tion. When embodying the horizontal angle of 45*, the tion effect to the sounds produced from the speakers, 
coefficient generator 18/ic in the allocating unit 18/j sets In the first embodiment described heretofore, a plu- 
the multiplication coefficients ki to ki2 for the multipli- rality of sound-directing devices are provided such that 
ers 18h1 to 18/tl2 such that the same amount of data is 55 each of them corresponds to a predetermined direction, 
supplied to the sound-directing devices FIR2 and FIR3 while a rate of the acoustic data to be allocated to each 
which respectively correspond to the horizontal angles sound-directing device is adjusted. Further, a pair of the 
of 30* and 60*. coefficients which represent the head-related transfer 
Similarly, in the allocating unit 18/ the coefficient function and which also correspond to one predeter- 
generator 18/c sets the multiplication coefficients mi to 60 mined direction are supplied to each of the sound- 
mi2 for the multipliers 18/1 to 18/12 with respect to the directing devices. Instead, an average among three or 
sound source, the location of which is far from the more pairs of the coefficients which respectively corre- 
location of the listener. In order to allocate the acoustic spond to three or more directions can be supplied to 
data to the sound-directing devices, the directions of each sound-directing device so as to intentionally 
which are slightly apart from the target sound-image 65 weaken tile sound localization effect (or make the 
direction, an allocating rate for the sound-directing sound-image location unclear). 

device FIR1 is set at 0. 1; allocating rates for the sound- In the aforementioned embodiment, the sound-direct- 
directing devices FIR2 and FIR3 are both set at 0.4; and ing devices are provided with respect to twelve direc- 
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tions which are arranged in a horizontal plane. How- 
ever, at least three horizontal directions are required 
when localizing the sounds. Therefore, the number of 
the sound-directing devices is not limited to twelve. 
The aforementioned embodiment employs the notch 
filter 15 in order to localize the sounds in the vertical 
direction. This notch filter 15 can be replaced by the 
sound-directing device and the like, because the sound- 
directing device can also perform the sound localization 
with respect to the vertical direction. 

In the aforementioned embodiment, only one channel 
of the acoustic data is inputted to the apparatus. How- 
ever, by increasing the number of the circuits each 
having the configuration as shown in FIG. 6, it is possi- 
ble to simultaneously perform the sound localization 
with respect to plural channels of the acoustic data. 

In order to convert the acoustic data (i.e., binaural 
signals) into the sounds which are produced from the 
speakers, the aforementioned embodiment utilizes the 
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initial period. In contrast, the present embodiment em- 
bodies the data processing corresponding to the above 
initial period by the delay portion which is separated 
from the sound-directing device. In the second embodi- 
ment, the FIR filter which corresponds to the main 
impulse responses is called as the sound-directing de- 
vice. 

A second feature of the second embodiment lies in 
that a number of the delay portions (each of which is 
separated from the sound-directing device as described 
above) is set identical to a number of the acoustic data 
applied to the apparatus, while a pair of the sound- 
directing devices are provided with respect to each of 
the acoustic data. The above-mentioned first and sec- 
ond features of the present embodiment will result in 
the clear sound localization effect and low system cost. 
The reasons will be described below. 

In the sound localization control apparatus, the most 
important element which is required for obtaining the 



cross-talk canceller 20. However, when listening to the 20 sound localization effect is a difference between times at 
sounds by a headphone set, the cross-talk canceller 20 which sound waves are respectively sensed by left and 
can be omitted from the circuitry shown in FIG. 6. right ears of the person or a difference between ampli- 

rrvi o , „ , ,. tudes of those sound waves. This is because the person 

[B] Second Embodiment monitors the sound-image direction by use of the left 

A first feature of the second embodiment lies in that 25 and right ears. 



the sound-directing device conventionally used is di- 
vided into two parts. This feature will be described in 
conjunction with FIG. 12. 

When an impulse sound is applied to the dummy head 
DH (see FIG. 1) at a moment t=0, such impulse sound 
is picked up by the microphones ML and MR which are 
provided in the dummy head DH, so that the corre- 
sponding impulse response is obtained. FIG. 12 is a 
graph showing a variation of the impulse response with 
respect to time t(s). 

According to FIG. 12, it is observed that an impulse- 
response level is zero (or very small) for a certain period 
of time after the moment t— 0 (s); and then, an initial 
impulse response having a low level is occurred; and a 
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The above-mentioned element may be effective when 
monitoring the sound-image location with respect to 
the horizontal direction. However, that element is not 
so effective when monitoring the sound-image location 
with respect to the vertical direction or the distance. 
For this reason, the aforementioned head-related trans- 
fer function is introduced to accurately respond to the 
sound-image location, sensed by the person, which is 
affected by a scattering manner and a reflection manner 
of the sound waves as well as the shape of the human 
head and the shape of the ears. By use of the head- 
related transfer function, it is possible to obtain the 
sound localization effect with respect to all of the fac- 
tors including the vertical direction and the distance. 



main impulse response having a high level is occurred; 40 Incidentally, the sound-localization control in the verti- 



thereafter, the impulse-response level is gradually re- 
duced in a lapse of time. The impulse-response wave- 
form depends on the location at which the impulse 
sound is produced. However, the impulse-response 
waveform as shown in FIG. 12 (in which a variation of 45 
the impulse-response level is indicated in a digital man- 
ner) shows a typical waveform for the impulse-response 
waveforms generally obtained. 
Under the consideration of the above-mentioned im- 



cal direction can be simply embodied by use of the 
notch filter. 

When observing each of tile digital data representing 
the impulse-response waveforms picked up by the left 
and right ears, there exists a non-response period from a 
moment t=0 (s). In the non-response period (see FIG. 
12), the impulse-response levels are almost at zero. Due 
to tile existence of die non-response period with respect 
to each of the impulse-response waveforms respectively 



pulse-response waveform, the present embodiment ig- 50 picked up by the left and right ears, it is well known that 



nores the small initial impulse response. In other words, 
the present embodiment delays an initial period until the 
main impulse response is occurred as the delay time. 
Therefore, in such initial period (i.e., delay time), the 
present embodiment does not perform the data process- 
ing by use of the sound-directing device. Of course, it is 
possible to perform the data processing on the initial 
impulse response, whereas such data processing results 
in the complicated control to be required when per- 



a time difference between non-response periods respec- 
tively corresponding to the sound waves picked up by 
the left and right ears may be one of the most important 
elements when obtaining the sound localization effect 
55 Because, a distance between the sound source and the 
left ear is different from a distance between the sound 
source and the right ear, resulting that an arrival time 
(Le., non-response period) by which the sound wave 
reaches the left ear is different from an arrival time by 



forming the delay operation in the second embodiment 60 which the sound wave reaches the right ear, in other 



Since the initial impulse response does not substantially 
affect the sound localization, the initial impulse re- 
sponse can be separated from the main impulse re- 
sponse. 

Thus, the present embodiment uses the FIR filter as 65 
the sound-directing device dealing with the main im- 
pulse responses. In the sound-directing device conven- 
tionally used, the coefficients are set at zero during the 



words, an amplitude of the sound wave transmitted to 
the left ear is different from that of the sound wave 
transmitted to the right ear. Further, it is well known 
that an amplitude difference between the main impulse 
responses respectively corresponding to the left and 
right ears may be another one of the most important 
elements. In the second embodiment, the above-men- 
tioned time difference is embodied by the delay portion, 
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while the amplitude difference is embodied by the mul- 
tiplier which functions to adjust the amplitude. The 
delay portion and the multiplier are provided indepen- 
dently of the sound-directing device. 

The delay portion can be configured by a random-ac- 5 
cess memory (i.e., RAM) and an address control por- 
tion. Herein, it is necessary to provide a memory capac- 
ity for the RAM by which the data corresponding to 
the delay time can be stored; and the address control 
portion is provided to control a write address and a read 10 
address for the RAM. Due to such simple configuration 
of the delay portion, it is possible to manufacture the 
delay portion with a low cost. Further, it is necessary 
for the multiplier to perform the multiplication using 
the multiplication coefficient such that an amplitude of 15 
the impulse-response waveform can be adjusted. There- 
fore, this multiplier can be also manufactured with a 
low cost. Since a combination of the delay portion and 
the multiplier adjusting the amplitude is the most impor- 
tant circuit portion for the second embodiment, it 20 
should be provided independently for each of the acous- 
tic data applied to the apparatus. However, the system 
cost required for the apparatus will not be raised up so 
much. 

Meanwhile, the sound-directing device is provided to 25 
perform the convolution operation on the main impulse 
responses. However, if a plenty of the sound-directing 
devices are provided such that the sound sources corre- 
sponding thereto are tightly arranged in the space, the 
apparatus cannot be manufactured with a low cost. For 30 
this reason, the present embodiment limits the number 
of the sound-directing devices at twelve, the number of 
which corresponds to twelve horizontal directions to be 
arranged with respect to the predetermined distance. 
Therefore, as similar to the foregoing virtual speaker 35 
method, a weighted allocation is carried out on the 
acoustic data when allocating the acoustic data to the 
sound-directing devices respectively so as to eventually 
localize the sound image at the target sound-image loca- 
tion. In the second embodiment, the delay time is ad- 40 
justed by the delay portion provided before the sound- 
directing device. Thus, different from the virtual 
speaker method, even if the sounds-image location is 
put at a certain location between the locations respec- 
tively corresponding to the sound-directing devices, it 45 
is possible to obtain a clear sound-image localization 
effect 

In order to control the sound localization in the verti- 
cal direction by use of the notch filter, at least two 
sound-directing devices are required theoretically, be- 50 
cause one of the sound-directing devices covers an 
upper portion of the space, while the other covers a 
lower portion of the space. Those two sound-directing 
devices may be effective when obtaining a certain de- 
gree of the sound localization effect in the vertical di- 55 
rection. Through the experiments, it is known that more 
than four sound-directing devices are effective when 
controlling the sound localization effect in the vertical 
direction. Since the multiplier which performs the mul- 
tiplication to adjust the amplitude of the main impulse 60 
response is provided independently of the sound-direct- 
ing device, it is possible to normalize the coefficients 
used for the sound-directing devices. 

As described above, operations which are required to 
control a certain portion of the impulse-response wave- 65 
form in real time can be embodied by the delay opera- 
tion, amplitude adjusting operation and allocation oper- 
ation which can be controlled easily. Herein, the delay 



operation is performed by the delay portion, while the 
other operations are performed by the multipliers. 
Thus, the second embodiment does not require a high- 
speed processor; in other words, even a general-use 
processor can satisfy the needs of the second embodi- 
ment. As described before, the sound-directing device is 
inevitably configured by a large-scale circuitry. How- 
ever, different from the aforementioned coefficient 
time-varying method, it is not necessary to change the 
coefficients in the second embodiment. Thus, the sec- 
ond embodiment does not require the super-high-speed 
processor as the sound-directing device. Further, the 
number of the sound-directing devices can be reduced 
in the second embodiment. For example, some sound- 
directing devices or ten or more sound-directing de- 
vices are sufficient in the second embodiment. Further- 
more, each sound-directing device can be commonly 
used for plural acoustic data. For these reasons, the 
system cost required for manufacturing the apparatus of 
the second embodiment may not be raised up so much. 
In the meantime, all of the delay-time difference, ampli- 
tude difference and head-related transfer function are 
set in an ideal state as if the sound image may really exist 
at a desired location. Thus, as compared to the virtual 
speaker method in which the virtual speakers are ar- 
ranged not so tightly in the space, the second embodi- 
ment can achieve a very clear sound localization effect. 
(1) Configuration of Second Embodiment 

FIG. 13 is a block diagram showing a diagrammatical 
configuration of the sound localization control appara- 
tus according to the second embodiment of the present 
invention. The apparatus shown in FIG. 13 is designed 
to respond to plural acoustic data SI to Sn, the number 
of which is set at "n" (where "n" denotes an integral 
number). 

In FIG. 13, numerals 111S1 to lllSn designate notch 
filters respectively receiving the acoustic data SI to Sn. 
Each of the notch filters performs a frequency-band 
eliminating process on each acoustic data -so as to re- 
move a certain vertical-direction component from the 
acoustic data, wherein the vertical-direction component 
has a certain frequency band with respect to the vertical 
direction of the target sound-image location. That 
notch filter is controlled responsive to a parameter NC 
given from a controller MM1, the details of which will 
be described later. Thus, the acoustic data which has 
been processed by the notch filter represents a sound 
image which has been localized in the vertical direction 
with respect to the target sound-image location. 

Next, numerals 112S1 to 112Sn designate delay por- 
tions respectively receiving the output data of the notch 
filters 111S1 to lllSn. Each of the delay portions sepa- 
rate the output data of the notch filter into a left-channel 
component and a right-channel component, which are 
respectively delayed in response to distances DL and 
DR. Herein, "DL" designates a distance between the 
left-side microphone ML and the target sound-image 
location, while "DR" designates a distance between the 
right-side microphone MR and the target sound-image 
location. The abovementioned left-channel component 
and right-channel component for the acoustic data are 
respectively delayed by delay-time parameters DTL 
and DTR which are given from the controller MM1. A 
pair of multipliers 113LS1 and 113RS1 is coupled with 
the delay portion 112S1, while a pair of multipliers 
113LS2 and 113RS2 is coupled with the delay portion 
112S2, so that each pair of the multipliers 113LS1 to 
113LSn and 113RS1 to 113RSn is coupled with each of 
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the delay portions 112S1 to 112Sn. Each pair of the 
multipliers receives the output data of each delay por- 
tion so as to multiply the left-channel component and 
right-channel component by attenuation coefficients gL 
and gR respectively. Those attenuation coefficients gL 5 
and gR are given from the controller MM1. By the 
multiplications respectively performed by two multipli- 
ers coupled with each delay portion, the left-channel 
component and the right-channel component are re- 
spectively controlled such that a left-channel tone vol- 1° 
ume and a right-channel tone volume (or left-channel 
and right-channel amplitudes) are respectively adjusted 
to be matched with the target sound-image location. 

Numerals 114S1 to 114Sn designate allocating units 
respectively receiving the outputs of the multipliers 15 
113LS1 to 113LSn and 113RS1 to 113RSn. Each of the 
allocating units performs a predetermined weighted- 
allocating operation on the left-channel component and 
right-channel component for each of the acoustic data 
SI to Sn. For example, the allocating unit 114S1 re- 20 
ceives the left-channel component and right-channel 
component for the acoustic data SI, which are given 
from the multipliers 113LS1 and 113RS1 coupled with 
the delay portion 112S1. In the allocating unit, the left- 
channel component for the acoustic data is divided into 
twelve left-channel components with respect to twelve 
horizontal directions, while the right-channel compo- 
nent for the acoustic data is divided into twelve right- 
channel components with respect to twelve horizontal 3Q 
directions. The allocating unit 114S1 is configured by a 
coefficient controller CC and multipliers LI to L12 and 
Rl to R12. 

The coefficient controller CC creates multiplication 
coefficients GLi to GLi 2 and GRi to GR12 in response 35 
to the horizontal angle Those multiplication coeffici- 
ents are respectively set as shown in FIG. 14. Inciden- 
tally, the multiplication coefficient GL/ (where 
1 =j= 12) is set equal to the multiplication coefficient 
GRjw When comparing two multiplication coefficients 49 
GL/and GL y _i (where 2^J^12), a waveshape of the 
multiplication coefficient GL; is moved rightward by 
30° from a waveshape of the multiplication coefficient 
GL/_ i- The same thing can be said with respect to all of 
the multiplication coefficients GLI to GL12 and GRI 45 
to GR12. 

As shown in FIG. 14, if the horizontal direction rep- 
resented by the horizontal angle <{> corresponds to only 
one sound-directing device, only one multiplication 
coefficient is set at "1", while the other multiplication 50 
coefficients are all set at "0". On the other hand, if the 
horizontal direction represented by the horizontal angle 
<J> does not correspond to any one of the sound-directing 
devices, two multiplication coefficients corresponding 
to two sound-directing devices which are arranged 55 
close to that horizontal direction are set in a positive 
state, while the other multiplication coefficients are set 
at "0". 

In the allocating unit 114S1 shown in FIG. 13, the 
multipliers LI to L12 respectively perform the multipli- 60 
cations using the multiplication coefficients GLi to 
GL12 on the left-channel component given from the 
multiplier 113LS1, while the multipliers Rl to R12 
respectively perform the multiplications using the mul- 
tiplication coefficients GRi to GR12 on the right-chan- 65 
nel component given from the multiplier 113RS1. 

The other allocating units 114S2 to 114Sn have the 
similar configuration and operation of the allocating 
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unit 114S1; hence, the detailed description thereof will 
be omitted. 

Next, numerals 115L1 to 115L12 and 115R1 to 
115R12 designate adders receiving the outputs of the 
allocating units 114S1 to 114Sn. Herein, the adder 
115L1 adds a left-channel allocated component output- 
ted from the multiplier LI of the allocating unit 114S1 
with similar components respectively outputted from 
the allocating units 114S2 to 114Sn, while the adder 
115R1 adds a right-channel allocated component out- 
putted from the multiplier Rl of the allocating unit 
114S1 with similar components respectively outputted 
from the allocating units 114S2 to 114Sn. Similarly, 
each of the adders 115L2 to 115L12 adds the left-chan- 
nel allocated components together which are respec- 
tively outputted from the allocating units 114S1 to 
114Sn, while each of the adders 115R2 to 115R12 adds 
the right-channel allocated components together which 
are respectively outputted from the allocating units 
114S1 to 114Sn. 

Numerals 116L1 to 116L12 and. 116R1 to 116R12 
designate sound-directing devices, each of which per- 
forms the convolution operation on the basis of a pair of 
coefficients corresponding to the head-related transfer 
function. Incidentally, the abovementioned pair of coef- 
ficients is set responsive to the main impulse response 
and its continuous response which are occurred after 
the initial impulse response. Herein, the sound-directing 
devices 116L1 to 116L12 respectively perform the con- 
volution operations on the output data of the adders 
115L1 to 115L12, while the sound-directing devices 
116R1 to 116R12 respectively perform the convolution 
operations on the output data of the adders 115R1 to 
115R12. In the meantime, the sound-directing device 
116L1 corresponds to the horizontal angle of 0°; the 
sound-directing device 116L2 corresponds to the hori- 
zontal angle of 30°; and the sound-directing device 
116L12 corresponds to the horizontal angle of 330°. In 
short, each of the sound-directing devices 116L1 to 
116L12 provided for the left-channel allocated compo- 
nents is set responsive to every 30* in the horizontal 
direction. Similarly, each of the sound-directing devices 
116R1 to 116R12 provided for the right-channel allo- 
cated components is set responsive to every 30" in the 
horizontal direction. 

Next, an adder 117L adds the output data of the 
sound-directing devices 116L1 to 116L12 together so as 
to form the left-channel acoustic data, while an adder 
117R adds the output data of the sound-directing de- 
vices 116R1 to 116R12 together so as to form the right- 
channel acoustic data. A cross-talk canceller 118 per- 
forms the aforementioned anti-cross-talk processing on 
the left-channel acoustic data and right-channel acous- 
tic data respectively outputted from the adders 117L 
and 117R. As described before, the cross-talk compo- 
nents which are inevitably occurred in response to the 
position relationship between the listener and the speak- 
ers provided in the predetermined space can be re- 
moved from the left-channel and right-channel acoustic 
data by performing the anti-cross-talk processing. 

An amplifier 119 converts the left-channel and right- 
channel acoustic data given from the cross-talk cancel- 
ler 118 into analog acoustic signals. Then, the acoustic 
signals are amplified and then supplied to the speakers 
(not shown), from which the stereophonic sounds are 
produced. 

FIG. 15 shows an appearance and a partial configura- 
tion of the controller MM1, which is designed to desig- 
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nate the target sound-image locations in real time. This 
controller MM1 is manipulated by an operator (not 
shown) who may stand in front of the controller MM1. 
There are provided a touch sensor MM2 having a semi- 
spherical form, a slide switch MM3 and a select switch 5 
unit MM4 on a panel face of the controller MM1. 
Herein, the slide switch MM3 is provided to control the 
distance, while the select switch unit MM4 is provided 
to selectively designate one of plural acoustic data ap- 
plied to the apparatus. Incidentally, a numeral MM5 10 
designates a parameter generating portion, which is 
equipped within a main body of the controller MM1. 
However, for convenience sake, an illustration of the 
parameter generating portion MM5 is shown outside 
the controller MM1 in FIG. 15. 15 

On a surface of the semi-spheric touch sensor MM2, 
a plurality of voltage-sensitive lines (not shown) are laid 
as longitude lines and latitude lines. Herein, a certain 
interval which may correspond to a width of a finger tip 
is provided between adjacent voltage-sensitive lines; 20 
and an insulation is only effected at an intersection be- 
tween the longitude line and the latitude line, whereas 
the other portions of the semi-spheric surface of the 
touch sensor MM2 are not insulated. When a finger of 
the person touches the surface of the semi-spheric touch 25 
sensor MM2, a potential between the longitude line and 
latitude line is reduced in connection with a touching 
point. By detecting the potential reduced, it is possible 
to detect the touching point. Thus, it is possible to ob- 
tain longitude data and latitude data with respect to the 30 
touching point on the basis of a predetermined refer- 
ence point. Herein, the longitude data may correspond 
to the foregoing horizontal angle <J>, while the latitude 
data may correspond to the foregoing vertical angle 6, 
The scale which is designated by the slide switch MM3 35 
ranges from 0.2 m to 20 m. In other words, the shortest 
distance of 0.2 m can be designated by sliding the actua- 
tor of the slide switch MM3 in a front direction, while 
the longest distance of 20 m can be designated by sliding 
the actuator of the slide switch MM3 in a back direc- 40 
tion. By operating the slide switch MM3, it is possible to 
obtain distance data D designating a desired distance 
between the listener and the target sound-image loca- 
tion. By pushing one of the switches provided in the 
select switch unit MM4, it is possible to select one of the 45 
acoustic data applied to the apparatus. When pushing 
one switch, a value k (where 1 =k^n) designating a 
serial number of the acoustic data to be controlled is 
outputted. 

Based on the above-mentioned data <f>, 0, D and k, the 50 
parameter generating portion MM5 generates several 
kinds of parameters which are supplied to the sound 
localization control apparatus. For example, the param- 
eter generating portion MM5 generates the parameters 
representing delay times DTL(k), DTR(k), a horizon- 55 
tal-direction component <f>(k), a notch-filter coefficient 
NC(k) and attenuation coefficients gL(k) and gR(k) 
with respect to the acoustic data Sk. 
(2) Operation of Second Embodiment 

Next, the description will be given with respect to the 60 
operation of the apparatus which functions to localize 
the sounds at the target sound-image location. For ex- 
ample, a synthesizer (not shown) is activated to produce 
the running sounds of the car, while those sounds are 
produced from two speakers (not shown) so that the 65 
listener can hear those sounds. Incidentally, the speak- 
ers are respectively arranged in front of the listener 
such that the sounds are produced from a left-side 
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slanted direction and a right-side slanted direction. 
Acoustic signals corresponding to the running sounds 
of the car produced from the synthesizer are converted 
into acoustic data SI. The acoustic data SI representing 
the running sounds of the car are sequentially applied to 
the apparatus in which those data are subjected to data 
processings as described before, so that the correspond- 
ing sounds are produced from two speakers. 

When performing a sound effect in which the running 
sounds of the car are altered as if the car is running from 
the right to the left, the operator of the controller MM1 
(e.g., listener) touches a right-side portion of the semi- 
spheric surface of the touch sensor MM2 by a finger (or 
a hand) at first; thereafter, the operator gradually moves 
his hand in a backward direction and then moves his 
hand in a leftward direction while touching the surface 
of the touch sensor MM2. Synchronized with the above 
motion, the operator gradually slides the actuator of the 
slide switch MM3 from a back-side position to a front- 
side position. Until the touching point at which the 
operator touches the surface of the touch sensor MM2 
reaches a certain back-side position which is opposite to 
tile front position of the operator, the operator moves 
the actuator of the slide switch MM3 in a front direc- 
tion. However, after the touching point reaches- the 
above certain back-side position, the operator reverses 
an operation of the slide switch MM3 so that the opera- 
tor begins to move the actuator in a backward direction. 
In accordance with the above-mentioned complicated 
operations applied to the touch sensor MM2 and the 
slide switch MM3 respectively in a synchronized man- 
ner, the controller MM1 sends out several kinds of 
parameters as described before. 

Thus, the aforementioned delay portion 112S1 re- 
ceives the delay-time parameters DTL(l) and DTR(l) 
from the controller MM1 in connection with the acous- 
tic data SI. In this case, a right delay time DTR is set 
slightly shorter than a left delay time DTL at first. 
Thereafter, both of the delay times DTL and DTR are 
controlled to be shorter in accordance with the opera- 
tions of the touch sensor MM2 and the slide switch 
MM3. A difference between those delay times DTL 
and DTR becomes equal to zero when the touching 
point on the semi-spheric surface of the touch sensor 
MM2 reaches the aforementioned certain back-side 
position which is opposite to the front position of the 
operator. Thereafter, a relationship between the delay 
times DTL and DTR is reversed, so that the left delay 
time DTL is set shorter than the right delay time DTR. 
In accordance with the operation of the slide switch 
MM3 by which the actuator is slid in a backward direc- 
tion, both of the delay times DTL and DTR are con- 
trolled to be longer. 

When the touching point is located at a right-side 
portion of the semi-spheric surface of the touch sensor 
MM2, a left attenuation coefficient gL(l) is set smaller 
than a right attenuation coefficient gR(l). However, as 
the touching point is moved in a leftward direction, a 
relationship between those coefficients is reversed. Fur- 
ther, as the actuator of the slide switch MM3 is moved 
in a front direction to be closer to the operator, a sum of 
the attenuation coefficients gL(l) and gR(l) becomes 
larger. Thereafter, as the actuator of the slide switch 
MM3 is moved in a backward direction to be far from 
the operator, the sum of the attenuation coefficients 
becomes smaller. 

When the parameter generating portion MM5 gener- 
ates the horizontal-direction component <J>(1) in connec- 
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tion with the touching point on the semi-spheric surface 
of the touch sensor MM2, the aforementioned multipli- 
cation coefficients (or allocating coefficients) GLi to 
GLn and GK\ to GRn as shown in FIG. 14 with re- 
spect to the horizontal-direction component <f>(l). At 
first, the operator touches the touch sensor MM2 at its 
right-side portion, the allocating coefficients GL4 and 
GR4 corresponding to <f>=90° are set at "1". Thereafter, 
in synchronism with a moving operation of the touch- 
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accurately localize the sounds at the target sound-image 
location. 

Further, each of the sound-directing devices 116L1 
to 116L12 and 116R1 to 116R12 uses a pair of coeffici- 
ents which are fixed at certain values. For this reason, 
the second embodiment does not require the super- 
high-speed processor. In short, it is possible to config- 
ure the apparatus with simple and inexpensive circuits. 

The aforementioned second embodiment uses twelve 



ing point on the semi-spheric surface of the touch sensor 10 pairs of the sound-directing devices with respect to 



MM2, the allocating coefficients GL3 and GR3 are re- 
duced, while the allocating coefficients GL4 and GR4 
are raised up. Such cross-altering manner between the 
coefficients GL3, GR3 and the coefficients GL4, GR4 is 
shown in FIG. 14 between the horizontal angles of 60* 
and 90°. When the touching point is located at the afore- 
mentioned back-side position which is opposite to the 
front position of the operator, the allocating coefficients 
GLi and GRi are set at "1". Then, the allocating coeffi- 



twelve horizontal directions. However, the number of 
the sound-directing devices provided in the apparatus is 
not limited to twelve. In other words, the number of the 
sound-directing devices can be determined with respect 
15 to at least three directions in the space. 

In order to produce the sounds corresponding to the 
acoustic data, the second embodiment employs the 
speakers so that the cross-talk canceller 118 is required. 
However, if the listener uses the headphone set to listen 



cients are altered in. the aforementioned cross-altering 20 t0 sounds > toe cross-talk canceller 118 is not re- 
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manner. Finally, the allocating coefficients GL10 and 
GRioare set at "1". As described heretofore, the acous- 
tic data are processed in accordance with the head- 
related transfer function so as to eventually obtain a 
clear sound localization effect By the above-mentioned 25 
data processing, it is possible to alter the sound-image 
location in real time such that the running sounds of the 
car can be heard as if the car is really running in front of 
the listener from the right to the left. 

The present embodiment can perform the sounding 
effects in which the sounds of the car are reproduced as 
if the car is running on the highways or the car is jump- 
ing in some competition games, for example. In such 
sounding effects, the vertical-direction components 35 
must be considered when localizing the sounds. In 
order to do so, the operator touches the touch sensor 
MM2 and moves the touching point with respect to the 
vertical direction, the controller MM1 produces the 
notch-filter coefficient NC(1) which responds to the ^ 
vertical-direction component. The notch filter 111S1 is 
activated on the basis of the coefficient NC(1) so as to 
localize the sounds in a direction which is designated by 
the coefficient NC(1). In other words, the notch filter 
111S1 performs the sound localization in the vertical 45 
direction by removing the predetermined frequency- 
band components from the first acoustic data SI. The 
above frequency band to be removed is altered in accor- 
dance with the touching point to be moved on the semi- 
spheric surface of the touch sensor MM2. 

As described above, the second embodiment is char- 
acterized by that the delay portions 112S1 to 112Sn are 
separated from the sound-directing devices 116L1 to 
116L12 and 116R1 to 116R12. Such configuration of the 
second embodiment is advantageous in that the multipli- 
ers, which are included in the sound-directing devices 
conventionally used in the sound localization control 
apparatus, can be removed; and consequently, the sys- 
tem configuration of the apparatus as a whole can be 
simplified. 

In addition, tile delay times DTL and DTR which are 
respectively applied to the left-channel component and 
right-channel component of the acoustic data in each of 
the delay portions 112S1 to 112Sn are respectively com- 
puted in response to the distances DL and DR with 65 
respect to the target sound-image location- These delay 
times are effective to accurately perform the delay op- 
erations on the acoustic data. In short, it is possible to 
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quired. 

Operations of each delay portion and each sound- 
directing device can be embodied by use of the digital 
signal processor (i.e., DSP) in which micro programs 
are built in. 

Lastly, this invention may be practiced or embodied 
in still other ways without departing from the spirit or 
essential character thereof as described heretofore. 
Therefore, the preferred embodiments described herein 
are illustrative and not restrictive, the scope of the in- 
vention being indicated by the appended claims and all 
variations which come within the meaning of the claims 
are intended to be embraced therein. 

What is claimed is: 

1. A sound localization control apparatus comprising: 
a plurality of sound directing means, each for localiz- 
ing a sound corresponding to acoustic data applied 
thereto in each of predetermined sounding direc- 
tions; 

a designating means for producing a direction param- 
eter and a distance parameter in connection with a 
target sound-image location at which the sounds 
are localized, said direction parameter designating 
a direction from a listener who listens to the sounds 
to said target sound-image location, while said 
distance parameter designates a distance between 
the listener and said target sound-image location; 
and 

an allocating means for selecting at least one of said 
plurality of sound-directing means in response to 
the direction designated by said designating means, 
so that said allocating means allocates said acoustic 
data to said at least one sound-directing means 
selected, while said allocating means also allocates 
said acoustic data to one or some of said plurality of 
sound-directing means, other than said at least one 
sound-directing means selected, in response to the 
distance designated by said designating means, 

wherein outputs of said plurality of sound-directing 
means are mixed together to reproduce the sounds 
corresponding to said acoustic data which are lo- 
calized in accordance with said target sound-image 
location. 

2. A sound localization control apparatus comprising: 
a filter means for performing a predetermined filter- 
ing operation on acoustic data applied thereto to 
attenuate eliminate a predetermined frequency- 
band component in said acoustic data; 



a plurality of sound-directing means, each for impart- 
ing a predetermined sounding direction which is 
arranged in a horizontal plane with respect to a 
listener who listens to sounds corresponding to said 
acoustic data, each of said plurality of sound- 5 
directing means having a function to localize the 
sounds in each of the predetermined sounding di- 
rections; 

a designating means for producing a direction param- 
eter and a distance parameter in connection with a 10 
target sound-image location at which the sounds 
are localized, said direction parameter designating 
a direction from the listener to said target sound- 
image location, while said distance parameter des- 
ignates a distance between the listener and said 15 
target sound-image location; 

a dividing means for dividing output data of said filter 
means into first data and second data in response to 
the distance designated by said designating means; 

a first allocating means for allocating said first data to 20 
said plurality of sound-directing means in accor- 
dance with a first allocation ratio which is deter- 
mined in response to the direction designated by 
said designating means; and 

a second allocating means for allocating said second 25 
data to said plurality of sound-directing means in 
accordance with a second allocation ratio which is 
determined in response to the direction designated 
by said designating means, 

wherein outputs of said plurality of sound-directing 30 
means are mixed together to reproduce the sound 
corresponding to said acoustic data which are lo- 
calized in accordance with said target sound-image 
location. 

3. A sound localization control apparatus as defined 35 
in claim 2, wherein each of said plurality of sound- 
directing means is configured by a finite-impulse re- 
sponse filter. 

4. A sound localization control apparatus as defined 

in claim 2, wherein said filter means is configured by a 40 
notch filter. 

5. A sound localization control apparatus comprising: 
a designating means for producing a first delay time, 

a second delay time, a horizontal-direction parame- 
ter and a vertical-direction parameter on the basis 45 
of a distance and a direction from a listener who 
listens to a sound corresponding to acoustic data 
and a target sound-image location at which the 
sounds are localized; 
a filter means for performing a predetermined filter- 50 
ing operation on said acoustic data in response to 
said vertical-direction parameter to attenuate a 
predetermined frequency-band component in said 
acoustic data; 

a delay means for producing first data and second 55 
data on the basis of output data of said filter means, 
said delay means delaying said first data by said 
first delay time, while said delay means also delays 
said second data by said second delay time; 

a plurality of first sound-directing means and second 60 
sound-directing means, each pair of said first 
sound-directing means and said second sound- 
directing means being applied with each of prede- 
termined sounding directions which are arranged 
in a horizontal plane with respect to the listener, 65 
each of said plurality of first sound-directing means 
having a function to localize the sound in each of 
the predetermined sounding directions in connec- 
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tion with a left ear of the listener, while each of said 
plurality of second sound-directing means has a 
function to localize the sound in each of the prede- 
termined sounding directions in connection with a 
right ear of the listener; 

a first allocating means for allocating said first data 
delayed to said plurality of first sound-directing 
means in accordance with a first allocation ratio 
which is determined in response to the horizontal- 
direction parameter; and 

a second allocating means for allocating said second 
data delayed to said plurality of second sound- 
directing means in accordance with a second allo- 
cation ratio which is determined in response to the 
horizontal-direction parameter, 

wherein outputs of said plurality of first sound-direct- 
ing means are mixed together with outputs of said 
plurality of second sound-directing means to repro- 
duce stereophonic sounds corresponding to said 
acoustic data which are localized, in accordance 
with said target sound-image location. 

6. A sound localization control apparatus as defined 
in claim 5, wherein said filter means is configured by a 
notch filter. 

7. A sound localization control apparatus as defined 
in claim 5, wherein each of said plurality of first sound- 
directing means and second sound-directing means is 
configured by a finite-impulse response filter. 

8. A sound localization control apparatus comprising; 

sound-image location designating means for designat- 
ing a direction of a sound-image location from a 
listener and a distance between said sound-image 
location and the listener in order to localize a sound 
corresponding to an acoustic signal; 

first binaural signal producing means for imparting a 
first transfer characteristic to the acoustic signal 
supplied thereto in response to the direction desig- 
nated by said sound-image location designating 
means to produce a first binaural signal, said first 
binaural signal being formed by two-channel ste- 
reophonic signals; 

a second binaural signal producing means for impart- 
ing a second transfer characteristic to the acoustic 
signal supplied thereto in response to the direction 
designated by said sound-image location designat- 
ing means to produce a second binaural signal, said 
second binaural signal being formed by two-chan- 
nel stereophonic signals, said second transfer char- 
acteristic being determined such that the listener 
will feel as if said sound-image location is made 
unclear as compared to said first transfer character- 
istic; 

allocating means for allocating the acoustic signal to 
said first and second binaural signal producing 
means in response to the distance designated by 
said sound-image location designating means, 
wherein an allocation ratio is controlled such that 
as the distance becomes longer, the allocation ratio 
to said second binaural signal producing means 
becomes larger; and 

adding means for adding said first and second binau- 
ral signals together with respect to each of two 
channels so as to produce a third binaural signal. 

9. A sound localization control apparatus as defined 
in claim 1, wherein each of said plurality of sound- 
directing means is configured by a finite-impulse re- 
sponse filter. 



10. A sound localization control device for localizing 
sounds for a listener, the device comprising: 

a plurality of sound directing circuits that each local- 
ize a sound corresponding to acoustic data applied 
thereto in each of a plurality of predetermined 5 
sounding directions; 

a designating circuit that produces a direction param- 
eter and a distance parameter in connection with a 
target sound-image location at which the sounds 
are localized, the direction parameter designating a 10 
direction from the listener who listens to the 
sounds to the target sound-image location, and the 
distance parameter designating a distance between 
the listener and the target sound-image location; 

an allocating circuit that selects at least one of the 15 
plurality of sound-directing means in response to 
the direction parameter designated by the designat- 
ing circuit, so that said allocating circuit allocates 
the acoustic data to the at least one selected sound- 
directing circuit, while the allocating circuit also 20 
allocates the acoustic data to one or some of the 
plurality of sound-directing circuits, other than the 
at least one selected sound-directing circuit, in 
response to the distance parameter designated by 
the designating circuit; and 25 

a mixing circuit which mixes outputs of the plurality 
of sound-directing circuits together to reproduce 
the sounds corresponding to the acoustic data 
which are localized in accordance with the target 
sound-image location. 30 

11. A device according to claim 10, wherein each of 
the plurality of sound-directing circuits includes a finite- 
impulse response filter. 

12. A sound localization control device for localizing 
sound for a listener, the device comprising: 35 

a filter circuit that performs a predetermined filtering 
operation on acoustic data applied thereto to atten- 
uate a predetermined frequency-band component 
in the acoustic data; 

a plurality of sound-directing circuits that each im- 40 
part a predetermined sounding direction which is 
arranged in a horizontal plane with respect to the 
listener who listens to sounds corresponding to the 
acoustic data, each of the plurality of sound-direct- 
ing circuits having a function to localize the sounds 45 
in each of the predetermined sounding directions; 

a designating circuit that produces a direction param- 
eter and a distance parameter in connection with a 
target sound-image location at which the sounds 
are localized, the direction parameter designating a 50 
direction from the listener to the target sound- 
image location, and the distance parameter desig- 
nating a distance between the listener and the tar- 
get sound-image location; 

a dividing circuit that divides output data from the 55 
filter circuit into first data and second data in re- 
sponse to the distance designated by the designat- 
ing circuit; 

a first allocating circuit that allocates the first data to 
the plurality of sound-directing circuits in accor- 60 
dance with a first allocation ratio which is deter- 
mined in response to the direction parameter desig- 
nated by the designating circuit; 

a second allocating circuit that allocates the second 
data to the plurality of sound-directing circuits in 65 
accordance with a second allocation ratio which is 
determined in response to the direction parameter 
designated by the designating circuit; and 
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a mixing circuit which mixes outputs of the plurality 
of sound-directing circuits together to reproduce 
the sound corresponding to the acoustic data 
which are localized in accordance with the target 
sound-image location. 

13. A device according to 12, wherein each of the 
plurality of sound-directing circuits includes a finite- 
impulse response filter. 

14. A device according to claim 12, wherein the filter 
circuit includes a notch filter. 

15. A sound localization control device for localizing 
sound for a listener having a left ear and a right ear, the 
device comprising: 

a designating circuit that produces a first delay time, 
a second delay time, a horizontal-direction parame- 
ter and a vertical-direction parameter on the basis 
of a distance and a direction from the listener who 
listens to a sound corresponding to acoustic data 
and a target sound-image location at which the 
sounds are localized; 

a filter circuit that performs a predetermined filtering 
operation on the acoustic data to produce filtered 
output data in response to the vertical-direction 
parameter to attenuate a predetermined frequency- 
band component in the acoustic data; 

a delay circuit that produces first data and second 
data on the basis of the filtered output data from the 
filter circuit, the delay circuit delaying the first 
data by the first delay time, and the delay circuit 
delaying the second data by the second delay time; 

a plurality of first sound-directing circuits and second 
sound-directing circuits, each pair of the first 
sound-directing circuits and the second sound- 
directing circuits being applied with each of prede- 
termined sounding directions which are arranged 
in a horizontal plane with respect to the listener, 
each of the plurality of first sound-directing cir- 
cuits having a function to localize the sound in each 
of the predetermined sounding directions in con- 
nection with the left ear of the listener, and each of 
the plurality of second sound-directing circuits 
having a function to localize the sound in each of 
the predetermined sounding directions in connec- 
tion with the right ear of the listener; 

a first allocating circuit that allocates the first data 
delayed to the plurality of first sound-directing 
circuits in accordance with a first allocation ratio 
which is determined in response to the horizontal- 
direction parameter, 

a second allocating circuit that allocates the second 
data delayed to the plurality of second sound- 
directing circuit in accordance with a second allo- 
cation ratio which is determined in response to the 
horizontal-direction parameter; and 

a mixing circuit which mixes outputs of the plurality 
of first sound-directing circuits together with out- 
puts of the plurality of second sound-directing 
circuits to reproduce stereophonic sounds corre- 
sponding to the acoustic data which are localized 
in accordance with the target sound-image loca- 
tion. 

16. A device according to claim 15, wherein said 
filter circuit includes a notch filter. 

17. A device according to claim 15, wherein each of 
the plurality of first sound-directing circuits and second 
sound-directing circuits includes a finite-impulse re- 
sponse filter. 
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18. A sound localization control device for localizing 
sound for a listener, the device comprising: 

a sound-image location designating circuit that desig- 
nates a direction of a sound-image location from 
the listener and a distance between -the sound- 5 
image location and the listener in order to localize 
a sound corresponding to an acoustic signal; 

a first binaural signal producing circuit that imparts a 
first transfer characteristic to the acoustic signal 
supplied thereto in response to the direction desig- 10 
nated by the sound-image location designating 
circuit so as to produce a first binaural signal, the 
first binaural signal being formed by stereophonic 
signals; 

a second binaural signal producing circuit that im- 15 
parts a second transfer characteristic to the acous- 
tic signal supplied thereto in response to the direc- 
tion designated by the sound-image location desig- 
nating circuit so as to produce a second binaural 
signal, the second binaural signal being formed by 20 
stereophonic signals, the second transfer character- 
istic being determined such that the listener will 
feel as if the sound-image location is made unclear 
as compared to the first transfer characteristic; 

an allocating circuit that allocates the acoustic signal 25 
to the first and second binaural signal producing 
circuits in response to the distance designated by 
the sound-image location designating circuit, 
wherein an allocation ratio is controlled such that , n 
as the distance becomes longer, the allocation ratio 
to the second binaural signal producing circuit 
becomes larger; and 

a mixing circuit which mixes the first and second 
binaural signals together to produce a third binau- 35 
ral signal. 

19. A method of localizing sound for a listener, the 
method comprising the steps of: 

localizing a sound corresponding to acoustic data 
applied thereto in each of a plurality of predeter- 
mined sounding directions with a corresponding 
plurality of sound-directing circuits; 

producing a direction parameter and a distance pa- 
rameter in connection with a target sound-image 
location at which the sounds are localized, the 45 
direction parameter designating a direction from 
the listener who listens to the sounds to the target 
sound-image location,, and the distance parameter 
designating a distance between the listener and the 
target sound-image location; 50 

selecting at least one of the plurality of sound-direct- 
ing circuits in response to the direction parameter; 

allocating the acoustic data to the sound directing 
circuit in at least one selected sound-directing cir- 
cuits, while allocating the acoustic data to one or 55 
some of the plurality of sound-directing circuits for 
the plurality of sound directions, other than the at 
least one selected sound-directing circuit, in re- 
sponse to the distance parameter; and 

mixing together the acoustic data allocated to the 60 
plurality of sound-directing circuits to reproduce 
the sounds corresponding to the acoustic data 
which are localized in accordance with the target 
sound-image location. 

20. A method of localizing sound for a listener, the 65 
method comprising the steps of: 

performing a predetermined filtering operation on 
acoustic data applied thereto to attenuate a prede- 
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termined frequency-band component in the acous- 
tic data to produced filtered output data; 

imparting a predetermined sounding direction with a 
plurality of sound-directing circuits corresponding 
to a plurality of sounding directions which are 
arranged in a horizontal plane with respect to the 
listener who listens to sounds corresponding to said 
acoustic data, each of the plurality of sound-direct- 
ing circuits having a function to localize the sounds 
in each of the predetermined sounding directions; 

producing a direction parameter and a distance pa- 
rameter in connection with a target sound-image 
location at which the sounds are localized, the 
direction parameter designating a direction from 
the listener to the target sound-image location, and 
the distance parameter designating a distance be- 
tween the listener and the target sound-image loca- 
tion; 

dividing the filtered output data into first data and 
second data in response to the distance parameter; 

allocating the first data to the plurality of sound- 
directing circuits in accordance with a first alloca- 
tion ratio which is determined in response to the 
direction parameter; 

allocating the second data to the plurality of sound- 
directing circuits in accordance with a second allo- 
cation ratio which is determined in response to the 
direction parameter; and 

mixing together outputs of the plurality of sound- 
directing circuits to reproduce the sounds corre- 
sponding to the acoustic data which are localized 
in accordance with said target sound-image loca- 
tion. 

21. A method of localizing sound for a listener having 
a left ear and a right ear, the method comprising the 
steps of: 

producing a first delay time, a second delay time, a 
horizontal-direction parameter and a vertical- 
direction parameter on the basis of a distance and a 
direction from the listener who listens to sounds 
corresponding to acoustic data and a target sound- 
image location at which the sounds are localized; 

performing a predetermined filtering operation on 
the acoustic data in response to the vertical-direc- 
tion parameter to attenuate a predetermined fre- 
quency-band component from said acoustic data to 
produce filtered output data; 

producing first data and second data on the basis of 
the filtered output data; 

delaying the first data by the first delay time; 

delaying the second data by the second delay time; 

selecting a plurality of first sound-directing circuits 
and second sound-directing circuits in a plurality of 
predetermined sounding directions that are each 
arranged in a horizontal plane with respect to the 
listener, each of the plurality of first sound-direct- 
ing circuits having a function to localize the sound 
in each of the predetermined sounding directions in 
connection with the left ear of the listener, while 
each of the plurality of second sound-directing 
circuits has a function to localize the sound in each 
of the predetermined sounding directions in con- 
nection with the right ear of the listener; 

allocating the delayed first data to the plurality of 
first sound-directing circuits in accordance with a 
first allocation ratio which is determined in re- 
sponse to the horizontal-direction parameter; 
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allocating the delayed second data to the plurality of 
second sound-directing circuits in accordance with 
a second allocation ratio which is determined in 
response to the horizontal-direction parameter; and 

mixing together outputs of the plurality of first 5 
sound-directing circuits with outputs of the plural- 
ity of second sound-directing circuits to reproduce 
stereophonic sounds corresponding to the acoustic 
data which are localized in accordance with said 
target sound-image location. 10 

22. A method of localizing sound for a listener, the 
method comprising the steps of: 

designating a direction of a sound-image location 
from the listener and a distance between the sound- j 5 
image location and the listener in order to localize 
a sound corresponding to an acoustic signal; 

imparting a first transfer characteristic to the acoustic 
signal supplied thereto with a first binaural circuit 
in response to the direction designated by the 20 
sound-image location to produce a first binaural 
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signal, the first binaural signal being formed by 
stereophonic signals; 

imparting a second transfer characteristic to the 
acoustic signal supplied thereto with a second bin- 
aural circuit in response to the direction designated 
by the sound-image location to produce a second 
binaural signal, the second binaural signal being 
formed by stereophonic signals, wherein the sec- 
ond transfer characteristic is determined such that 
the listener will feel as if the sound-image location 
is made unclear as compared to the first transfer 
characteristic; 

allocating the acoustic signal to the first and second 
binaural circuits in response to the distance be- 
tween the listener and the sound-image location, 
wherein an allocation ratio is controlled such that 
as the distance becomes longer, the allocation ratio 
to the second binaural circuit becomes larger; and 

adding the first and second binaural signals together 

to produce a third binaural signal. 

* * * * * 
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